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ABSTRACT 


Let  X(l) , . . . ,X(n)  be  pxl  random  vectors  with  mean  zero. 

1  n 

Put  S  *  —  £  X(t)X(t) ' .  When  X(t) , (t«l, . . . ,n)  are  distributed  as  i.i.d. 

t-1  ~ 

N(0,J) ,  (i.e.,  usual  multivariate  analysis),  many  authors  have  investigated 
the  asymptotic  expansions  for  the  distributions  of  various  functions  of  the 
eigen  values  of  S .  In  this  paper  we  will  extend  the  above  results  to  the 
case  when  {X(t)}  is  a  Gaussian  stationary  process.  Also  we  shall  derive 
the  asymptotic  expansions  for  certain  functions  of  the  sample  canonical 
correlations  in  multivariate  time  series.  Applications  of  some  of  the 
results  in  signal  processing  are  also  discussed. 


1 .  INTRODUCTION 


Recently  several  authors  have  Introduced  some  multivariate  methods  to 
multivariate  time  series  analysis.  Using  the  orthogonality  and  asymptotic 
normality  of  the  "Fourier  components"  of  time  series,  Priestley,  Rao  and 
Tong  (1973),  Brillinger  (1975)  and  Krishnaiah  (1976)  discussed  the  princi¬ 
pal  component  analysis  in  the  frequency  domain,  and  investigated  some  asympto¬ 
tic  properties  of  sample  principal  component  roots  and  test  statistics. 
Similarly  Hannan  (1970),  Brillinger  (1975)  and  Krishnaiah  (1976)  discussed 
the  canonical  correlation  analysis  in  the  frequency  domain,  and  Brillinger 
gave  the  limiting  distributions  of  estimates  of  canonical  correlation  co¬ 
efficients.  Also  Robinson  (1973)  gave  an  approach  of  canonical  correlation 


analysis  for  the  covariance  matrix  of  multivariate  time  series. 

In  this  paper  we  shall  discussa^the  asymptotic  distributions  of  eigen¬ 
values  of  sample  covariance  matrices  of  multivariate  time  series  since  the 

eigenvalues  play  a  fundamental  role  in  multivariate  problems /^In^kection 

V; 

we  shall  give  the  limiting  distribution  of  eigenvalues  of  sample  covariance 

* 

matrices  for  non-Gaussian  linear  vector  processes.  Furthermore,  in  Section  3,.£> 

v. 

we  shall  derive: the  asymptotic  expansions  of  certain  functions  of  eigenvalues 


of  covariance  matrix  for  multivariate  Gaussian  stationary  processes,  and 


discuss  their  applications  for  time  series  principal  component  analysis. 

"TV;  * 

In  Section  4 -we  shall  give  ^the  asymptotic  expansions  of  certain  func¬ 
tions  of  canonical  correlation  matrix  for  multivariate  Gaussian  stationary 


processes,  and  discuss^some  asymptotic  properties  of  a  test  statistic  for 
canonical  correlations. 


2.  CENTRAL  LIMIT  THEOREM  FOR  EIGENVALUES  OF  COVARIANCE  MATRICES 


In  this  section  we  give  the  central  limit  theorem  for  eigenvalues  of 
sample  covariance  matrices.  In  the  sequel,  the  set  of  all  integers  is  denoted 
by  J  and  the  Kronecker's  delta  is  denoted  by  S(m,n). 

Let  {X(t)  :  teJ}  be  a  vector-valued  linear  process  generated  as 

00 

x(t)  -  l  G(j)  e(t-j) ,  t  e  J, 

**  j-0 

where  the  X(t)'s  have  p  components  and  the  e(n)'s  are  q-vectors  such  that 

•»  mm 

E{e(n)}  =  0  and  E{e(m) ,e(n) ' }  *  6(m,n)K,  with  K  a  nonsingular  qxq  matrix; 

mm  mm  mm  mm 

the  G(j)'s  are  pxq  matrices;  and  the  components  of  X,  e  and  G  are  all  real. 

mm  mm 

OO 

If  £  trG(j)KG(j)'  <  “»  (this  condition  is  assumed  throughout  in  this  section) 
j=*0 

the  process  (X(t)}  is  a  second-order  stationary  process  and  has  a  spectral 

mm 

density  matrix  |((w)  which  is  representable  as 

<$(w)  *  —  k(w)K  k(w)*,  -it  <  w  <_  it, 

2tt 


where 


k(w)  -  l  G(j)eiwJ. 

j-o 


Suppose  that  observed  stretch  (X(l) . X(n)}  of  (X(t)}  is  available.  Define 

mm  mm  mm 

1  n 

C(0)  *  —  ^  X(t)X(t)',  and  denote  the  (a,S)  components  of  C(0),  (((w),  k(w) 


n 


t=  1 


and  K  by  C(a,S),  i  fl(w),  k  a  (w)  and  K  and  denote  the  ath  component  of 
as  as  ac 


X(t)  and  <?(t)  by  X  (t)  and  e  (t) ,  respectively.  Assuming  that  {e(t)>  is 
«,  «,  a  a  . 


fourth-order  stationary,  let  Q  (t,,t0,t,)  be  the  joint  fourth  cumulant 

a ^ . .a^  l  4  j 


of  e  (t),  e  (t+t.),  e  (t+t_),  e  (t+t_)  and  assume  that 
a,  a-  1  *  a,  2'  a.  3 

12  3  4 


WV 


"  “•  (1  -  “l1 


»aA  l  <0; 


then  the  process  (e(t)}  has  the  fourth-order  spectral  density  Q  (w.,w0,w») 

*»  1  Z  J 


such  that 


~e  .  .  1 

«  (w,  =  - 


«1.„b,vT’2,’3/  '  ,,  .3  f  * 

1  4  (2ir)  t1»t2»t3=' 


exp{-  iCwjtj-h^^+w-t.)  } 


X  Qo1...o4(tl,t2»t3)* 


X  ~x 

Similarly  we  can  define  Q  (t-,t,,t,)  and  Q  (w.,w-,w.),  respectively, 

d«  •  •  «Cl  i  1  Z  J  01.  «  •  (U  /  1  Z  J 

14  14 


the  fourth-order  cumulant  and  spectral  density  of  the  process  (X(t)}, 


1  <_oi^,...,a4  p.  Denote  by  6 (t)  the  a-field  generated  by  {e(n);  n<t}. 

We  set  down  the  following  assumptions. 

Assumption  1.  For  each  8^,82  and  s 


Var[E{ eft  (t)efi  (t+s) | B(t-t) }  -  5(s,0)K  .  ] 

61  82  6162 


0(t-2_£) ,  £  >  0, 


uniformly  in  t 


Assumption  2. 


E!E{eS  (tl)eB,(t2)eB  (t3)eB  (V  I  e(trT)} 

I  4  3  4 


”  E{es/tl'>e6,(t:2)e6  (t3)e6,  (t4)}  I  =  0(t  n)* 

12  3  4 


uniformly  in  where  tj  <_  t2  <_  t3  <_  and  n  >  0. 


Assumption  3. 

The  spectral  densities  6ftR(w)  (8  *  1 . p)  are  square-integrable. 


Assumption  4. 


1  lQa  o  a  (tl»t2,t:3)I  < 

tl,t2’t3— "  14 


Now  define  V (0)  ■  E{C(0)},  and  denote  the  (ct,B)  component  of  T (0)  by 
f (cx,B) .  The  following  lemma  is  due  to  Hosoya  and  Taniguchi  (1982). 


Lemma  1 . 


Under  Assumptions  1-4, 


v^n*  (  C  (ct  ^  )  —  T  (a1,a2)  },  C  ct  ^  9  oc  ^  —  l,...,p) 


have  a  joint  asymptotic  normal  distribution  whose  mean  is  zero  and  the  asymptotic 
covariance  between  ✓n’  (CCo^.o^)  -  TCc^.o^)}  and  Sn  (C(a3,a4)  -  r(a3,a4)} 
is  given  as 


5 


2tt  \  a  (w)7  (wT  +  6  (w)7  (wT)  dw 

— tt  ata3  a2a4  ala4  Sa3 

+  2t  ^  ^  k«  8  (w1)k„  8  (-Wl)krt  8  (w2)k«  8  (~W2^ 

-i  alBl  1  a2e2  1  a3B3  2  a4B4  2 

*  ^B1...64  (wi.-w2’w2)dwldw2‘  ° 

Let  >  •••  >  ^  be  the  eigenvalues  of  C(0).  Then  we  can  express 
C(0)  =  BLB',  where  L  =  diag  (SL ^  , .  „ . ,  £^) ,  B  Is  the  orthogonal  matrix.  Suppose 
that  the  eigenvalues  of  F(0)  satisfy  X^  >  ...  >  X  ,  and  that  T(0)  *  4*  AH'  * 
where  \  =  diag(X  ^ , . . . ,  X  )  and  'V  =  (6^»...,Bp)  is  the  orthogonal  matrix. 

We  assume  that  Xp...,X  have  the  following  spectral  representations 

r  ~ 

“  J  ^j(w)dw,  (j  »  l,...,p),  (2.1) 

oo  00 

where  (w)  -  |k  (w)|2,  and  k  (w)  -  £  G  («.)ei£w  with  £  |g  (;.)  |2  <  ®. 

JJ  ^  JJ  JJ  JJ  ,j=0  JJ 

Let  T  =  'y,C(0)4',  and  put  U  =  >/n(T-A) .  Then,  denoting  the  (i.j)  component 

of  U  by  u  ,  from  Lemma  1,  {u^}  have  a  joint  asymptotic  normal  distribution 

whose  mean  is  zero  and  the  asymptotic  covariance  between  u^  and  is  given 

as 

u (ij  »k£)  =  2tt  y  +  giJt(w)gjk(w)  }  dw 

+  2 iirjj  kil(w1)kjj(-w1)kkk(w2)ku(-w2)Q®jk!l(w1,-w2,w2) 


x  dWjdw2 , 


(2.2) 


where  (w)  ■  a^^(w) 6 (i. j ) ,  Then  we  get  the  following  theorem. 

Theorem  1.  Under  Assumptions  1-4,  the  joint  distribution  of  D  =  /rT(L-A) 

*•  *»  «• 

and  G  =  t^T(B-'i')  tends  to  that  of  D  =  diag(u^ ,  0 . .  .u^^)  and  G  =  fW,  where 

-  -  —  -  Uii 

W  »  (w  },  with  w  .  •  0,  w„  «  t — *—  ,  i  ^  j  and  {u  }  is  distributed  as 

lj  li  lj  Aj-Ai  *J 

a  multivariate  normal  distribution  whose  mean  is  zero  vector  and  the  covariance 

between  tl  and  is  given  as  y(ij,k£)  defined  in  (2.2).  In  particular 

if  the  process  is  Gaussian,  then  the  limiting  distribution  of  D  and  G  = 

(h.,...,h  )  is  normal  with  D  and  G  independent  and  the  diagonal  elements 
<•  1  «•  P 

of  D  are  independent.  The  diagonal  element  d^  of  D  has  the  limiting  distri¬ 
bution 


N  (0,  4tt  |  g  (w)2dw). 


The  covariance  matrix  of  the  ith  eigenvector  is 


Var{h  } 
«•  1 


7-7-7  j  8ii(")8kk(”)d"‘fk!k’ 

“"A.  )  — ^ 


and  the  covariance  matrix  of  h  and  h,  in  the  limiting  distribution  is 

-j 


Cov{h . ,h . }  = 
•l  *0 


w 


I 

)  8li(w)g.  .(w)dwB  6'. 

-TT  ^  ^  ~ 


[Proof]  Let  T  =  YLY’,  where  Y  is  orthogonal.  Put  W  =  /n(Y-I)  =  {w^}. 
Using  the  same  arguments  as  Anderson  (1984,  p.  541),  and  substituting 
T  ■  A  +  —  U,  Y  *  I  +  —  W  and  L  *  A  +  —  D  to  the  equations  T  =  YLY'  and 


(i  =  1 . p) ,  w 


I  =  YY',  we  get  =  u^. 


li  ■  °*  ”ij  ‘  TTt’  1  *  3  •  1  5 

J  i 


l,...,p„  Noting  v/n  (B-'f)  =  TO  and  Lemma  1,  we  get  the  des-'red  results.  □ 

Remark.  For  non-Gaussian  case,  the  distribution  of  D  and  G  are  not  always 
asymptotically  independent. 

Now  we  confine  ourselves  to  the  case  when  {X(t)}  is  Gaussian  and  consider 
the  asymptotic  distribution  of  the  q  smallest  roots  of  C(0)  when  the  q  smallest 
population  roots  are  equal.  Let 


A,  0 


t  81 

q. 


where  the  diagonal  elements  of  the  diagonal  matrix  A^  are  different  and  larger 
than  0  (>0).  We  assume  that  the  eigenvalues  A.,,.., A  (A.  >  ...  >  A  > 

i  pi  p  q 

Ap_q+i  =  . o .  =  Ap  =  0)  have  the  following  spectral  representations  given 
in  (2.1); 


r 

-IT 


A.  =  J  ^.(w)dw. 


(2.3) 


0 

with  (5p_q+1  >p_q+1(w)  =  ...  =  t$pjp(w)  =  uniform  spectra), 


As  a  criterion  to  test  the  null  hypothesis 


H  :  A  >...  >  A  .=...=  A  ^  0 , 

1  p-q  p-q+i  P 


(2.4) 


where  A  (j  =  l,...,p)  have  the  spectral  representations  (2.3),  we  use  the 
following  criterion 


^  i-p-q+1  A 


In  the  usual  multivariate  analysis  this  is  known  as  the  likelihood  ratio 
criterion.  Using  the  similar  arguments  in  Anderson  (1984,  p.  475-6),  we 
can  see 


L 


-V  i 

9  i<j 


p-q+l<i 

1  ±S> 


P 

+  %{  i 

i=p-q+l 


P 

- (  £  u  )  }]  +  higher  order  terms.  (2.6) 

q  i-p-q+1  11 

Since  we  assumed  (2.3),  we  can  see  that 

uii(i  -  p-q+1 . p)  and  u^(i  f  j ,  i»j  -  p-q+l,...,p) 

2  2 

are  asymptotically  distributed  as  i.i.d.  N(O,20  )  and  l.i.d.  N(O,0  ),  respectively 
By  (2.6)  we  have. 

Theorem  2.  Under  the  null  hypothesis  H,  the  limiting  distribution  of  the 

2 

test  statistic  L  tends  to  the  x  -distribution  with  1s(q+2)(q-l)  degrees  of 


freedom 


3.  ASYMPTOTIC  EXPANSIONS  OF  CERTAIN 
FUNCTIONS  OF  EIGENVALUES  OF  COVARIANCE  MATRIX 


In  this  section  we  derive  the  asymptotic  expansions  of  certain  func¬ 
tions  of  eigenvalues  of  covariance  matrix  in  multivariate  time  series. 

Here  we  assume  that  {X(t)  *  (X- (t) . X  (t))':tej}  is  a  pxl-vector-valued 

1  P 

Gaussian  stationary  process  with  zero  mean  and  covariance  matrices 
T(j)  =  E{X(t)X(t+j) '}. 

Assumption  5.  The  covariance  matrices  satisfy 
00 

I  lul  ||r(u)  ||  <  »,  (3.1) 

U=-oo 


where  ||(r(u)j|  is  the  square  root  of  the  maximum  eigenvalue  of  T(u)  T(u)  ' . 
Then  the  spectral  density  matrix  of  (X(t)}  is  given  by 

^(w)  3  27  £  r(u)e_iuw. 

U=— <x> 

1  11 

Let  !L  >  ...  >  l  be  the  eigenvalues  of  the  matrix  C(0)  =  —  T  X(t)X(t) ' 

1  -  -  p  n 


and  let  >_...>_  X  be  the  eigenvalues  of  T(0)  such  that 


...  —  X 


=  9 


(3.2) 


H.+. . .+q  -+1 

1  na-l 

H-  +  . .  .+q 

1  ^ct 

a 

for  a  =  l,2,...,r,  q^+...+qr  =  p. 

and  q  =0. 
o 

Also ,  let  T .  (  i,  , . . . ,  i  ), 
j  1  P 

(j  =  l,...,k)>  be  an  analytic  function  of  about  X^,...,X^. 


In  addition,  let 


for  geJa,  heJg ,  tej^,  X'  *  (X]L,...,Xp)  and  2’  -  (^,...,0  where  Jq 

denotes  the  set  of  integers  q^+. . .+qa_j+l,  . ..,  q^+...+qa  for  a  =  1,2 . r 

In  this  section  we  are  interested  in  obtaining  the  asymptotic  joint  distri¬ 
bution  of 

</n{T.  (  2_  , . . . ,  2  )  -  T.  (X-  , . . .  ,X  )},  (j  =  1 . k)  . 

j  I  P  J  1  P 

Expanding  T  (£^,...,£p)  as  Taylor  series,  we  obtain 

V2!*-**,  p>  "  VV  —  .y  +  ajct  J  Ug"6a) 

s  a 

+  T  l  j*J..  I  l  <VV(  W 

a»l  0=1  J  geJa  hsJg 

+  |  I  I  I  I  I  l  <  *g-V ( W ( *t-V 

b  a=l  6-1  y-1  J  Y  geJ  heJD  teJ  8  T 


a  0  Y 


+  higher  order  terms. 


Now ,  let  Lj  —  Vti{  Tj  (2^,...,2p)  —  (X-^,...,Xp)}  for  j  —  l,2,...,k. 


L  -  I  a  tr(Wa-6aI)  +  2  l  I  aja6 

J  a-1  a-1  6-1 


x  tr (W  -0  I)tr(W  -0  I) 
a  a  0  6 

+  4  I  1  I  a,  tr(W  -0  I)tr(W  -8.I)tr(W  -e  I) 

6  L,  Lt  j«SY  a  a  0  0  Y  Y 

ct=l  0-1  y*I 

+  higher  order  terms, 

where  W  is  a  random  matrix  with  eigenvalues  £  ,  geJ  .  and  I  is  an  identity 
a  g  a 

matrix.  If  we  assume  that  W  is  of  the  form; 


then  1,^  is  of  the  following  form 


L.  =  l  a.  tr  W(1)  +  I  a  tr  W( 
J  €1=1  **  °  ^Ct=l 


(2) 


+  I  f  ?  a  tr  W(1)  tr  W(1\ 

+  2  L  /.  aja6  tr  a  tr  W6  > 
a=l  3=1 


+  higher  order  terms. 

The  following  lemma  is  due  to  Fujikoshi  (1977) 


Lemma  2.  Let  T  be  a  square  random  matrix  and  d^  ...  >  d^  be  the  eigenvalues  of 
T.  Also,  let  A^  :>  .  . .  be  the  corresponding  population  eigenvalue  such  that 


Ai  =  =  \  =  6r 


A  ,  ,  *  ...  =  A  ,  =  9_ 

q,+l  qx+q2  2 


A  =  9 
P  r 


In  addition,  we  assume  that  T  can  be  expressed  as 

T  =  A  +  eU(1)  +  e2U(2)  +  ...  , 


where  A  =  diag(A^ , . . . , A^)  and  e  >  0  is  very  small.  Then  the  eigenvalues  d^ 


(jeJa)  are  the  eigenvalues  of 


Z  =  9  I  +  eZ(l)  +  e2Z(2)  + 
a  a  q  a  a 

a 


where 


21  U22  '  2 


...  l/ 

v  rl  r2  r 


and  Uv„  is  of  order  q  xq 
a3  a  ^3 

Applying  this  lemma  to  our  normalized  covariance  matrix  U  defined  in  the 
previous  section  we  have 


L.  *  f  a.  trU  +  {  S  a.  tr  f  (0  -eo)_1U  QU 

J  l  jo  act  /n  1  [  ja  £  a  3  a3  I 

a=l  a»l  0j*a 


+  i  1  1  aia«trUaatrU86^  +  higher  order  terms. 

a=l  3=1  J  p  p 


(3.3) 


Here  we  also  assume  that  the  eigenvalues  have  the  spectral  representations  in 
(2.1).  Applying  Lemma  1  for  Gaussian  case  it  is  not  difficult  to  show  that 

E(L . )  ’  -  {  [  [  £  £  a  (0  -9  r1 

^  i/n  a=l  3^a  ieJ  keJ  ^  a 

a  3 


x  2n  j  |$ii(w)((kk(w)dw 

-IT 

r 

k  E  1  a.  4ir  f  l^.-(w)2dw}  +  0(n  X) 
a-1  ieJ  J  in  1 


=  c^/Vn  +  0(n  ),  (say). 


(3.4) 


r  r 

cum{L.,L  }  =  cum{  /.  A  a.  U,  .  ,  )  )  a  -U.  -.  -} 

j  m  i  u  t  Jo  kk  *  i  t. -  t  ma  k  k 

J  a*l  keJ  J  a  =1  k  eJ  - 

a  a 


+  0(n  L) 


=  l  [  a.a  40 
u.  ,  ja  ma 
a=l  ksJ  J 


|  4k(w)2dw  +  0(n_1 ) 


Now  define 


*  cjm  +  °^n  (say)- 


n 


z  (i» j )  =  -  l  l  {x  (t)x.(t)  -  r(i,j)}] , 

n  /n  t-1  1  J 


(3.5) 


and 


X(l)  =  (X.(l),...,Zi(n))*. 


Then  we  can  express  as 


.CD 


l[  vu: 


where  I.  is  the  covariance  matrix  of  X^\  and  is  a  random  vector  dis 

i  - 

tributed  as  NCO^.I^).  Using  the  fundamental  properties  of  cumculants  (see 
Brillinger  (1975))  we  have 


cum{Zn(i1,j1),  Zn(i2'32)*  Zn(i3,J3)} 

-  -L  cum{Y  1  L  L  Y  1  ,  Y  2  L  L  Y 
n/n  "  xl  Jr  "  XZ  J2~ 


ri  (j’t) 


Y  3'} 


3  J3 


-  -»=  l^rt  t  tl\  l[  £ 

nv^n  *1  *2  *3  4  c5  6 


(3.6) 


±1' 


tr  T g  n  (n*n)r«  p  (n*n)T»  »  (n*n), 
n42  ^3*4  S  6 


where  I  is  the  sum  over  all  two  dimensional  indecomposable  partitions  of 


1,Jl  \  ri  ri 

i_,j„  ]  ,  and  F  (nxn)  “  •  To  evaluate  (3.6),  after  a  slight 


modification  of  Theorem  1  in  Taniguchi  (1983)  we  get  the  following  lemma. 

Lemma  3.  Let  X(t)  =  (X^(t), . . . .X^Ct)) 1  be  a  Gaussian  stationary  process  which 
satisfies  Assumption  5,  with  the  spectral  density  matrix  ^(w)  *  {^(w)}  and 


mean  zero .  Then 


—  tr  T.  .  (nxn) T.  .  (nxn)  ...  T.  ,  (nxn) 
n  iljl  ^2  isis 


(2tt) 


s-1 


/  L  ,  ML  ,  ,  (w)dw  +  0(n~  ) 

1  -tt  11J1  2  sJs 


(3.7) 


Using  this  lemma  for  (3.6)  and  noting  fundamental  properties  of  cumulants 
it  is  not  difficult  to  show 

2  r 


cum 


(L,  ,L  ,L  }  =  ^2-  J  £  a.  a  a  fn  L,(  w)Jdw 

j  m  S  4T  a-l  kej  ““  sai  kk 


+  r-  filled  Jr  I  ^klkl(w)  dW  f  ^k?k_(w)2dw 

Vn  a. 6=1  k  ej  k.cj0  ./  11  J  2  2 

’  1  a  2  6  -tt  -it 


-IT 
IT  _ 


x  ^ajaamBasa6  +  ajaam8as8a  +  ajaas8amaB  +  ajaas8amBct 


-3/2, 


+  a  a  Qa,  a  +  a  a  Qa.Q  }  +  0(n  ) 

sa  mB  jctB  sa  mB  jBa 


=  —  C.  +  0(n  3^2)  ,  (say) 


(3.8) 


r—  jms 
/n  J 

Therefore  we  get  the  following  asymptotic  expansion  (see  Taniguchi  (1986)) 


Theorem  3.  Under  Assumption  5,  we  have 


P(L1  <  <  V 

y’  7k  k  CL 


71  /k  k  C 

/  ...  .  M(y:flf)  [1  +  l  -1  H  (y) 

'  -oo  _eo  *•  i-1  /n  J  ~ 


j- 


k  C,  . 

+  l  —ISB.  h  (y)]dy  +  0(n  ), 

j.M-1  6v^  ^ms  ~  ' 


(3.9) 


-•  -* 
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where  y  -  (y^  . . .  ,yk>  ' ,  N(y:fi)  -  (2ir)“k//2  l"1^2  x  exp(-  j  y  , 


1  „,n-l 


*  N(y-.fi)  3y  ...3y  N(y:fi)* 
1  S  J1 


and  fl  *  (c.  },  (kxk-matrix) . 
jm 


Corollary  3.1.  Suppose  that  the  eigenvalues  of  T(0)  satisfy  X^  >  ...  X^  >  0 

and  T.(X.,...,X  )  =  X..  In  the  special  case  when  the  spectral  densities  are 
3  1  P  3 

constants  such  that 

X1 

"  27>  (j=l,...,p), 

(i.e.,  the  usual  multivariate  analysis  case),  the  expansion  (3.9)  becomes 

P{v/n(JL-X1)  <  y.  , . . .  ,i/n(  £ -X  )  <  y  } 

11  1  P  P  p 

7i  ,yP  .  pc. 

“  /  •  •  •  /  N(y:ft)  fl  +  l  -J-  H  (y) 

CO  CO  ~  j=l  ^  J  - 

—CO  —00 

P  C  -I 

+  l  -122.  H  (y)]dy  +  0(n_1),  (3.10) 

j.nfs-l  6^  JmS  ~  ' 


where 

c.  -  ^  (X  -X  )_lX  X  ’ 

j  B*j  j  8  j  8 

and  the  (j,m)  element  of  Q  is 

c jm  *  2S(j.*»y 


c  jms  =  8*  j5^.  ®)5(m,s) , 


which  coincides  with  the  result  of  Sugiura  (1976) . 


For  testing  H  :  X^  >  X^  «  . . .  ■  X  ■  6  (>  0)  against 

A  :  X  >  ...  >  X  >  0,  we  consider  the  criterion  L  defined  in  (2.5). 

p-q+1  -  -  p 

Then  we  get  the  asymptotic  expansion  of  L  under  the  nonnull  hypothesis. 


4.  ASYMPTOTIC  EXPANSIONS  OF  CERTAIN  FUNCTIONS  OF  CANONICAL  CORRELATIONS 

In  this  section  we  derive  the  asymptotic  expansions  of  certain  functions 
of  sample  canonical  correlations  in  multivariate  time  series.  Let  X(t)'  - 

(Xx(t)\  X2(tV)  -  (X1(t),...,Xp(t)fXp+1(t).....Xp4ti(t)).  (p<.q),  be  a  (p+q)- 

vector-valued  Gaussian  stationary  process  with  zero  mean  and  covariance  matrices 
T(j)  m  E{X(t)X(t+j) which  satisfy  Assumption  5.  Also  we  assume  that 

(X(t) }  has  the  spectral  density  matrix  ({(w)  ■  {£  ft(w)}.  Put 


C(0)  -  ~  l  X(t)X(t)»  - 


r(0)  -  e{C(0)} 


Y  ■  /n  {C(0)-r(0)}  - 


S11  S12 
S21  S22 


/Mu 

1*21  M22 


Yll  Y12 
Y21  Y22 


Define  the  pxq  matrix  G  as 


G  -  Mu 


By  the  singular  value  decomposition  theorem,  there  exist  two  orthogonal  matrices 
Tj  and  r2  of  order  pxp  and  qxq,  respectively,  such  that 

G  -  TjPr^ 

2 

where  P  -  {diag(Pl . .  )|0},  PP'  -  diagC^, . . . ,Xp) ,  and  -  pt,  (i  -  !.••••?) 


"i  ■  rIMn  • 
’2  '  r2^  • 


.  jv  ..***-  .  ’w*  ^  .  • _ '  t.  *-*.  *'  *  .  vlx.’  a.1’, 


Define 


Then,  using  a  similar  argument  to  Fang  and  Krishnaiah  (1982) ,  we  can  see 


<”!,"lsTlS12S22S2l'r[ 


PP’  +  — (PV21  -  PV22P'  +  V12P’  -  V11PP») 


& 


+  ^PV22V22P'  -  PV22V21  +  V12V21  '  V12V22P' 


-  VUPV21  +  V11PV22P'  -  V11V12P'  +  V11V11PP'> 


0p(n-3/2), 


(4. 


where  V  *  =  1,2)* 


Now,  without  loss  of  generality  we  assume  that  (X(t)}  has  the  covariance 

•0 

matrix 


1  0  P,  0 


r(0)  = 


0  1 


P1  ° 


\  o  p 


0 

1 

0 


(4.2) 


0 

1 


\  0 


ijjp  (w) 


\ 


\ 


\ 

0  ■ 


^(w)  =  {  Lv(w)  } 


r(p), 


6J^(w) 


6$  (w) 


(4.3) 
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with 


J 

— TT 


6 2i  ■*  <”w)dw 


«p  '  ( w) dw. 


-  r-a» 


(w)dw,  j  - 


/  TT 


1  =  )  ^2)(w)dw»  j  =  1  »•••»<!• 

— ' TT 


So  we  may  assume  that  it.  =  I  and  tt~  =  I  .  Let  2..  >  . ..  >  2  be  the  eigen- 
J  lp  2  q  1—  —  p 

values  of  SjJs^S^Sjj ,  and  let  (^ , . . .  ,2p)  ,  (j  =  be  an  analytic 

function  with  the  same  notations  defined  in  the  previous  section.  We  set 
down 


=  i/n"  {T\  , . . . ,  2^)  —  T\  ( A ^ , . . . ,  A^)  }  {  j  —  1 


—  1 , . . . ,k, 


where  X.,...,X  satisfy  the  relation  (3.2).  Then,  using  the  same  arguments 
1  P 

and  notations  we  have 


.  =  la.  tr  W(1)  +  —  {  I  a.  tr  W*- 
i  la  a  r~  ,  Ja  a 

J  a«l  J  /n  a=l  J 


(2) 


r  r 


+  %  l  l  a.  „  (trW^)  (trW^)  +  higher  order  terms, 
o=l.  6=1  JaS  a  6 


(4.4) 


W 


a)  .  „o> 


aa 


W 


<2)  ■  “if  +  j  - 

Bra 


with 


where 


U 


U 


(1)  _  pv  -PY  P'+Y  P’-Y  PP ' 

21  22  12  11 


(2) 


PY  Y  p'-PY  Y  +Y  Y 

22  22  22  21  1 12  21 


Y  Y  P'-Y  PY  +Y  PY  P' 

X12  22*  Mr  21  Ml  22 


Y11Y12P’  +Y11Y11PP,‘ 


9 


Define 

U(k,m)  =  P.Y(p+k,m)  -  P,P  Y(p+k,p+m) 
K  Km 

+  P  Y(k,p+m)  -P^Y(k,m), 
m  m 

V (m,k)  =  P ^Y(k+p,m+p)  -Y(k,nrt-p), 


where  Y(a,S)  is  the  (a,B)th  component  of  the  matrix  Y.  Then,  by  (4.4)  we  have 


Lj  =  l  ajct<  I  U(k,k) } 


a=l  J  keJ 


+  7:  <  I  ajaf  III  V(m,k)2 

/n  ot—  1  J  i=l  keJ  meJ. 

a  i 


4. 

-II  l  Y (k,m)U(m,k) 


i=l  meJ  meJ. 

a  i 


+  I  (9  -6ft)_1  l  l  U(k,m)U(m,k) ] 
8*a  keJ  meJ. 


r  r 

+  %  t  l  a.„ft  [  I  U(k,k)U(m,m) } 

a=l  8=1  ^  keJ  m£j_ 

a  8 


+  higher  order  terms, 


where  J  ^  denotes  the  set  of  integers  p+l,...,q.  We  denote 


K^(m,k:m,k)  =  E(V(m,k)}  , 


K^Ckjmtm.k)  =  E{Y (k,m)U (m,k) } , 


(k,m:tn,k)  =  E{U(k,m)U(m,k) } , 


Kuv(e,,£:m,k)  =  E{U(£, £)V(m,k) } . 


K^Ckjnws)  =  /n  cum{U(k,k) ,U (m,m) ,U (s , s) } . 


Then  using  Lemma  1  for  Gaussian  case  we  can  see  that 


K  (m,k:m,k) 
w 

~  2Tpk  5  n+<5(m,k)  (w)  if22^w)dw 

-tr 

-  4TTPk  5  (  ^5°  (w)  (w)  +  6(m,k)^2(^)(w)^1(”)(w)}dw 


k  *  U21  v  y u22 

-7T 


+  2tt  )  (^)(w)^2)(w)  +  5  (m,k)  (w)2}dw  +  0(n_1), 

— 7T 

/  TT 

K  (k,m:£,£)  =  [4ttp  £  \  ^  (w)  {  ^  (w)  +  ^ (w) }dw 

~  4ttP^  j  l51(2)(w)!$2(J)(w)dw  -  4irp2  ^  (w)  2dw]  6  (k,  £)  5  (m, ! 


+  0(n-1) , 


K  (k,m:m,k) 
uu 

f  TT 

-  2ttP£P2  \  {l+6(m,k)H151^)(w)t5I(“)(w)  +  (w)  (w)  }d 

-TT 

C  TT 

-  27rpkp^  1  IU<W(v)  +  5(m,k)^)(w)}^(“)(w) 

— TT 

+  {l+5(m,k)}^2^w)^22^w^  +  ^21^w^  +  6  (m,k)  (w)  H2 

TT 

-  2irpkpm  !  [{l+6(m,k)H^(^(w)^1(“)(w)  +  ^)(w)^“)(w)} 

—IT 

+  {|^2^w)  +  'S(m,k)j$^(w)}|522^(w)]dw 

STT 

{  1+6  (m,k)  }  (w)  ^  (w)  dw 

-ir 

“2irpm  i  (w)  +  5  (®»k)  <5 (w)  }  $  11  ^  (w)  dw 

-TT 

+2ttp2  j  {  i$22^  (w)  (w)  +  5(m,k)($2^  (w)  >dw 

— TT  '  “ 

+2irpm  ^  ^22^W^11^W^  +  <s(m,k)^2^w^i2^w^dw 

— TT  *" 

+2^PkPm  \  {^2i^w^21^W^  +  ^22^W^11^W^ 

+^12^W^12^W^  +  5  (m.k)^)  (vr)^^  (w)  ^dw 

/  TT 

+2"P 3P  J  (w)6.^  (w){  1+5 (m,k)  )dw 

K.  m  ^  Z 1  LZ 

f7T 

+2*P,P3  j  !$1(^)(w)^^)(w){l+5(m,k)}dw  +  0(n_1), 


K  (m,k:£,£)  = 


0(n  )  for  all  m  f  k,  £ 


0(n”  )  for  all  m  =  k  ^  £, 


,(£,£:m,k)  *  lOirp^  (  (w)  |$2^(w)dw 


-4-rrP^  \  {($22^w)2  +  (w^dw 


-4irp£  )  (w)2  +  !$22^w)^ii^w^dw 


22  '  /ull 


+2tt  P„  +  (^f}(w)  +  ^(!)(w)))$1(f)(w)}dw 


£  )  D22  v"'u12 
-IT 


+  0(n  1), 


*  0(i i"1). 


for  £  =  m  =  k. 


otherwise. 


Let  A  be  the  set  of  integers  k  and  p+k,  and  let 


Y(j1»j2) 


Jr 2pk  ,  if  \ix-i2\  -  1. 


Up£  ,  if  |jrj2|  =  o. 


Then,  using  Lemma  3  we  have 


Kuuu^k:m:s)  =  (27r)  I  Y(j1»j2)Y(J3,^4)Y(^5,:36) 


Y*  f1*1/ 

4  )  ®v.v0(w)^  (w)  (w)dw  +  0(n  *), 

v  -tt  12  uv_v,  v  uvcv, 

3  4  5  6 


for  k  *  m  ■  s. 


0 


otherwise 


12  I 

£  i 

where  £  is  the  sum  of  all  two  dimensional  indecomposable  partions  of  ^ J 4)  r 


Ld 

V 

i 

j  ‘t  > 

Thus  noting 

(4.5)-(4. 10) ,  it  is  easy  to  show  that 

E(L.)  -  —  C(1)  +  0(n"3/2), 

(4.11) 

cum{ L  ,L  }  =  +  0(n-1) , 

j  a  3s 

(4.12) 

cum{L^  ,Lg  »L^)  -  +  0(n‘3/2), 

(4.13) 

where 

ri\  r  r+1 

Cj U  “  l  ajo  {X  l.  1  Kw  (m’k:m’k) 

a-1  J  i=l  keJ  m£j. 

0  i 

~  1  1  1  K^Ck.mrm.k) 


1=1  kcJ  meJ. 

a  i 


+  y  (0  -0O)  I  I  K  (k,m:m,k)} 

-if  a  B  ,  lt  lt  uu 
Bra  keJ  mEJ„ 

a  p 


j. 

+  h  I  a.  y  K  (k,k:k,k) , 

t  not  “  mi  ’ 


,  jaa  ,  uu 

a=l  J  keJ 


(4.14) 


' f2^  =  y  a,  a  y  K  (k,k:k,k), 
js  o-l  jasakeJ  UU 


(4.15) 


CpJ  -  y  a.  a  a0  V  (K  (k:k:k) 

-  - "  In  an  tn  ^  uuu 


jsl  i  jo  sc.  1.  k‘j 

a 


+  6K  (k,k:k,k>  -  6K  (k,k:k,k)K  (k,k:k,k)} 


y  { 

“  .  “ja”sB  £a8  “jB  £a“saB  “£B“sa  jaB' 

ct  i  p=  i 


I  I  K  (k,k:k,k)K 


ke J  me J  B 
a  p 


Therefore  we  get  the  following  asymptotic  expansion  (see  Taniguchi  (1986)) 


Theorem  4 


where 


^(1*^  ^  y1,...,Lk  ^  y^) 


(yi  If  c; 

...  \  N(y:«)[l  +  l  H .  (y) 

Jo  -Jo  -  1=1  /n  3  ~ 


k  , 

+  I  H  (y)]dy  +  0(n_1), 

j,s,Jl=l  6^n  3S  *  " 


ft  =  (C:  3},  (kxk-matrix) , 
J  s 


Now  consider  the  test  of 


H  =  > 


o. 


^(k+D(w)  =  . 


■  •  =  “  °* 


^+1)(w)  -  ...  -  «  <5oo+1)(w)  »  ...  -  L(^(w)  = 


against 


2  2  2 

A  :  P  k+1  1  •••  LP  p  L  0  and  P  k+1  >  °*  (b,V. 

For  this  test  problem  we  use  the  following  statistic 

P 

Q  =  -nlog  IT  (1-4  ).  (4 . 2 1 

J-k+1  J 

In  the  usual  multivariate  analysis  (4.20)  is  known  as  the  likelihood  ratio 
statistic  for  testing  H.  Then,  under  H,  it  is  not  difficult  to  show 

Q  =  ][  ^  Y(4,p+j)^  +  higher  order  terms.  (4.2 

4=k+l  j=k+l 

Thus  we  have 

Proposition  1.  When  the  null  hypothesis  H  is  true,  the  limiting  distribution 

2 

as  n  ”  of  Q  is  the  x  -distribution  with  (p-k)  (q-k)  degrees  of  freedom.  □ 
Using  Theorem  4  we  can  get  the  asymptotic  expansion  of  Q  under  the  non¬ 
null  hypothesis. 

Proposition  2.  Let  T^ ^k+l • »^p)  =  ~  Q  in  Theorem  4.  Then,  under  A,  we 
have 

ptv^Ti(W....y  -  VPk+1 . 4)}  **0 

y  C(1)  c (3) 

-  J  1  N(y  ;fi)[l  +~I-H1(y1)  +-^-  Hul(y1)]dy1 

-°>  /n  6vn 

+  0(n-1) , 

where  Q  and  are  defined  in  (4.14),  (4.15)  and  (4.16),  with 
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5  APPLICATIONS  IN  SIGNAL  PROCESSING 


Consider  the  following  model  in  the  area  of  signal  processing. 


x(t)  =  As(t)  +  n(t) 


(5.1) 


where  A  =  (A(*1) , . . .  ,A(*  ) ] ,  s(t)  =  (s^t) . sq(t))'  n(t)  *  (n^t) , . . .  ,np(t)  ] ' 

and  q<  p.  Here  n(t)  is  complex  Gaussian  white  noise  process  with  E(n(t))  =  0, 
E(n(t)n(t)')  =  a  I  covariance  matrix  o  Ip.  Also,  s^(t)  is  the  wave  form  associated 
with  i-th  signal.  In  addition  s(t)  is  assumed  dimentionai  complex  Gaussian  sta¬ 
tionary  to  be  process  with  E(s(t))  *  0  and  E(s(t)s(t)')  =  ip.  The  processes  s(t)  and 
n(t)  are  independent  of  each  other.  Wax  and  Kailath  (1984)  and  Zhao,  Krishnaiah 
and  Bai  (1985)  considered  the  problem  of  determination  of  the  number  of  unknown 
signals  by  using  information  theoretic  criteria  under  certain  assumptions.  The 
number  of  signals  is  equal  to  the  q  *  p-m  where  m  is  the  multiplicity  of  the  small¬ 
est  eigenvalue  of  the  covariance  matrix  I  of  x(t).  We  assume  that  x(t)  is  a  complex 

n  ~  _ 

stationary  Gaussian  process  and  let  ns  =  Z  x(t.)x(t.)'.  Test  of  hypotheses  for 

j*l"  J  "  J 

the  multiplicity  of  the  smallest  eigenvalue  of  Z  are  based  upon  certain  functions 
of  the  eigenvalues  of  S  and  so  the  results  in  this  paper  are  useful  in  determination 
of  the  number  of  signals. 


Next ,  let 


y(t)  *  Bs(t)  +  nn(t) 


(5.2) 


where  ng(t)  is  defined  as  n(t),  B:p*q  is  defined  as  A  and  y(t)  is  the  observation 
vector  on  p  sensors  located  at  different  locations.  In  this  case,  let  us  assume 
that  (x' (t) ,y 1 (t) )  is  distributed  as  complex,  stationary,  Gaussian  process.  The 
results  in  Section  4  are  useful  for  testing  for  independence  of  x(t)  and  y(t)  processes. 
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